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Abstract 

We consider the bipartite unconstrained 0-1 quadratic programming problem (BQP01) 
which is a generalization of the well studied unconstrained 0-1 quadratic programming 
problem (QP01). BQP01 has numerous applications and the problem is known to 
be MAX SNP hard. We show that if the rank of an associated m x n cost matrix 
Q = (<?«) is fixed, then BQP01 can be solved in polynomial time. The complexity of 
this algorithm is quasi-polynomial if rank of Q is 0(log fc n) for a fixed k. When Q is 
of rank one, we provide an 0(n log n) algorithm and this complexity reduces to 0(n) 
with additional assumptions. Further, if q^ = en + bj for some and bj, then BQP01 
is shown to be solvable in 0(mn log n) time. By restricting m = O(logn), we obtain 
yet another polynomially solvable case of BQP01 but the problem remains MAX SNP 
hard if m = \pn for a fixed k. Finally, if the number of negative entries in Q is fixed, 
BQP01 is shown to be polynomially solvable whereas it is NP-hard if this number is 
O(yfn) for a fixed k. Many of the algorithms we obtained provide a unified framework 
for polynomially solvable cases of QP01 and BQP01. 

Keywords: quadratic programming, 0-1 variables, polynomial algorithms, complexity, 
pseudo-Boolean programming. 

1 Introduction 

The unconstrained 0-1 quadratic programming problem (QP01) is to 

Maximize f(x) = x T Q'x + c'x + c' 
Subject to a; £ {0, l} n , 
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where Q' is an n x n matrix, d is a row vector in R n , and d is a constant. The problem 
QP01 is formulated and studied in various alternative formats. For example, without loss of 
generality, one can assume that Cq is zero, d is the zero vector and Q is symmetric. If d is 
allowed to be arbitrary, then the diagonal elements of Q can be assumed to be zero, without 
loss of generality. In another variation, x is assumed to be in { — 1, l} n instead of {0, 1}™. 
However, this variation can be reduced to the 0-1 version using a linear transformation. 
QP01 has been studied extensively in literature because of its various applications and rich 
theoretical structure. For further details and additional references on QP01 we refer to [U 
El [9j [TOl [HI [22]. The focus of this paper is on a problem closely related to QP01 which we 
call the bipartite unconstrained 0-1 quadratic programming problem (BQP01). The problem 
BQP01 can be defined as follows. 

Maximize f(x, y) = x T Qy + cx + dy + Co 
Subject to i £ {0, l} m , y G {0, 1}", 

where Q = (g^) is an m x n matrix, c = (ci, c 2 , . . . , c m ) is a row vector in R m , d = 
(di,d 2 , ■ ■ ■ ,d n ) is a row vector in R n and c is a constant. Without loss of generality, we 
assume that m < n. Let 

, c = [ c | d ] and w T — [ x | y ] , (1) 

where O nxn , Onxm and O m xm zero matrices. Then BQP01 can be formulated as the 
QP01 

Maximize f(w) = w T Qw + cw + c (2) 
Subject to w e {0, l} m+n . (3) 

Thus, the exact and heuristic algorithms available to solve QP01 can be used directly to 
solve BQP01. However, such a transformation increases the problem size and could limit 
our ability in handling large scale problems. Further, BQP01 has additional structure that 
can be exploited to obtain efficient algorithms and derive interesting theoretical properties. 

We can also show that QP01 is a special case of BQP01. Choose 

Q = Q' + 2MJ, c=^d - Me and d = -d - Me, (4) 

where / is an n x n identity matrix, e G R n is an all one vector and M is a very large number. 
Then the resulting BQP01 solves QP01 since the penalty parameter M forces x« = yi in an 
optimal solution of this modified BQP01. The transformation discussed in equation (j3J) is 
important since it provides additional flexibility in developing algorithms for QP01 through 
BQP01 formulations. This provides additional motivation to study BQP01. 
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BQP01 is also equivalent to the unconstrained bilinear program 



UBLP: 



Maximize g(x, y) = x T Qy + cx + dy + c 
Subject toxe [0, l] m , y G [0, l] n , 



which is a special case of the bilinear programming problem (BLP) [31 [T7J [32]. Note that 
the 0-1 variables in BQP01 are replaced by continuous variables in UBLP. It is well known 
that, for a BLP with variables x T = (x\, x 2 , ■ ■ ■ , x m ) and y T = (yi, y 2 , ■ ■ ■ , y n ), there exists 
an optimal solution (x*, y*), where x* is an extreme point of the constraint set defined by the 
x- variables and y* is an extreme point of the constraint set defined by the y- variables [17]. In 
UBLP, these constraint sets are {0, l}-hypercubes and hence UBLP is equivalent to BQP01. 
Thus, BQP01 can also be solved using any algorithm for solving the BLP. However, by 
exploiting the special structure of UBLP, more efficient algorithms may be obtained. To the 
best of our knowledge, UBLP has not been studied in literature from the point of view of 
bilinear programs exploiting the inherent structure of the problem. 

A graph theoretic interpretation of BQP01 can be given as follows. Let I — {1, 2, ... , m} 
and J = {1,2, ... ,n}. Consider the bipartite graph G = (I, J, E). For each node i <E I and 
j G J, respective costs q and dj are prescribed. Further, for each (i,j) G E, a cost q^ is 
given. Then the maximum weight induced subgraph problem on G is to find U\ C I ', f/ 2 ^ J 
such that YlieUi Ci + ^jet/ 2 + fieE 1 - 2 %' ^ s maximized, where E 1,2 is the edge set of the 
subgraph of G induced U\ U U2- The maximum weight induced subgraph problem on G is 
precisely a BQP01, where q-ij = if {i, j) E. 

Many well known combinatorial optimization problems can be modeled as BQP01. Con- 
sider the bipartite graph G = (J, J, E) with w,^ > being the weight of the edge (i, j) G E. 
Then the maximum weight biclique problem (MWBP) [U [30] is to find a biclique in G of 
maximum total edge- weight. Define 



where M is a large positive number. Set c and d as zero vectors and also set c = 0. Then 
the BQP01 with this choice of Q, c, d and Cq solves the MWBP. This immediately shows 
that BQP01 is NP-hard and one can also establish some approximation hardness results 
with appropriate assumptions [H [30] . MWBP has applications in data mining, clustering 
and bioinformatics [H [31] which in turn become applications of BQP01. 

Another application of BQP01 arises in approximating a matrix by a rank-one binary 
matrix [TTj [201 EI21 EH I2S]- For example, let H = (hij) be a given m x n matrix and we 
want to find an m x n matrix A = (ajj), where = UiVj and Ui,Vj G {0,1}, such that 
YliLi Sj=i(^ij — UiVj) 2 is minimized. The matrix A is called a rank one approximation of 
H and can be identified by solving the BQP01 with q^ = 1 — 2/ijj, q = 0, dj = and 
Co = for all z G J and j G J. Binary matrix factorization is an important topic in mining 
discrete patterns in binary data [231 ES]- If Ui and Vj are required to be in {—1, 1} then 
also the resulting approximation problem can be formulated as a BQP01. The maximum 




w i: j if (i,j)eE 
—M otherwise , 
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cut problem on a bipartite graph can be formulated as a BQP01 and this gives yet another 
application of the model. BQP01 can also be used to find approximations to the cut-norm 
of a matrix [2J. When the matrix Q' is positive semidefinite, QP01 can be solved directly 
as a BQP01. This follows from a corresponding result from BLP [17] and the equivalence 
between UBLP and BQP01. The applications and potential theoretical developments make 
it interesting to investigate BQP01 further. 

To the best of our knowledge, BQP01 has not been thoroughly investigated in literature, 
especially from the point of view of polynomially solvable special cases. The primary focus 
of this work is to identify such special cases and provide a concise review of the available 
results from the literature on BQP01. 

We show that BQP01 can be solved in polynomial time if the rank of Q is fixed. It may 
be noted that the corresponding version of QP01 is NP-hard even if Q is of rank one [13J. 
With the additional restrictions that Q' is positive semidefinite and d — 0, QP01 can be 
solved in polynomial time [U [TU1 UHl I23]- O ur algorithm can also be used to solve this special 
case of QP01 in polynomial time with the additional flexibility that c can be an arbitrary 
vector. When Q is of rank one, we show that BQP01 can be solved in 0(n log n) time. In 
addition, we obtain an 0(n) algorithm for a special case of this rank-one problem. When 
qij = di + bj, we present an 0(mn log n) algorithm. Further, we observe that if m = O(logn) 
then BQP01 can be solved in polynomial time but if m = y/n for a fixed k, the problem 
remains MAX SNP hard. If m = 0(\og k n) then BQP01 can be solved in quasi-polynomial 
time. Similarly, if the number of negative entries in Q are O(logn) then BQP01 is solvable in 
polynomial time but if the number of negative entries are 0{-\/n) for a fixed k, the problem 
becomes NP-hard. 

The paper is organized as follows. In Section 2, we present various equivalent formulations 
of BQP01. Section 3 deals with polynomially solvable special cases. Concluding remarks are 
given Section 4. 

2 Equivalent formulations 

QP01 is often presented in literature in various equivalent forms. Similar equivalent formu- 
lations can be obtained for BQP01 as well which are summarized in this section. Although 
many of the transformations discussed here follows almost directly from the corresponding 
transformation for QP01, we present them here for completness, comparison, and for no- 
tational convenience. Further, these transformations, albeit simple, preserve the bipartite 
structure of the problem which allows us establishing interesting complexity results. 

When the linear and constant terms from BQP01 are dropped, we get the homogeneous 
version of the problem defined as, 

BQPOl(H): Maximize f(x, y) = x T Qy 

Subject to x e {0, l} m ,ye {0, 1}™. 

In fact, the general BQP01 can be represented in the homogeneous form by introducing two 
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additional variables. Let 

0= [4t£]- (5) 

Then BQP01 is equivalent to 

BQP01(#): Maximize f{x,y) = x T Qy 

Subject to x G {0, l} m+1 , y G {0, l}"+\ x m+1 = 1, y n+1 = 1, 

where £ m +i and y n+ i are respectively the (m + l)th and (n + l)th components of x and y. 
The restrictions x m+ \ = l,y n+ i = 1 in BQPOl(ff) can be dropped by replacing c with a 
large number M in Q. Thus, we have 

Remark 1. A BQP01 can always be represented in an equivalent homogeneous form in the 
sense that the two problems have identical optimal solutions set. 

Another important variation of BQP01 is obtained by restricting the variables to 1 or 
— 1 instead of or 1. We call this the cut version of BQP01 and denote it by BQP-11. The 
problem BQP-11 can be stated as 

BQP-11: Maximize (f>(x, y) = x T Qy + cx + dy + c 

Subject to x e {-1, l} m , y e {-1, l} n . 

By dropping the linear and constant terms from BQP-11, we get the corresponding homo- 
geneous version 

BQP-11 (H): Maximize <j>(x,y) = x T Qy 

Subject to x e {-1, l} m , y G { — 1, l} n . 

As in the case of BQP01, its cut version BQP-11 can also be represented in the corresponding 
homogeneous form by introducing two additional variables. Let Q be defined as in equation 
© and x G {-1, l} m+1 , y G {-1, l} n+1 . Then BQP-11 is equivalent to 

BQP-11 (5"): Maximize <j>(x, y) = x T Qy 

Subject to x G {— 1, l} m+1 , y G {-1, 1}" +1 , x m+l = l,y n+1 = 1. 

Note that the restriction x m+ i = l,y n +i = 1 in BQP-ll(ff) can be replaced by x m +i = Vn+i 
without affecting the optimal solution of BQP-ll(ff). This is possible because, for any 
solution x, y with x m+ i = —1, y n +\ — — 1, the solution —x, —y satisfies — x m +i = 1, — Vn+i — 1 
and (f>(x,y) = 4>(—x, —y). Further, the condition x m+1 = y n+1 can be dropped by replacing 
Co with a large number M in Q resulting in a homogeneous version of BQP-11. Thus, we 
have 

Remark 2. A BQP-11 can always be represented in an equivalent homogeneous version in 
the sense that the two problems have identical optimal solutions set. 
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Consider the linear transformation 



x = 2w — e m and y = 2z — e n , (6) 

where e m and e n are all-one vectors in R m and R n , respectively. Using (jSJ), BQP-11 can be 
reduced to the BQP01 

Maximize f(w, z) = w T Qz + cw + dz + c 
Subject to w G {0, l} m , z G {0, 1}™, 

where Q = 4Q, c = 2(c — (Qe n ) T ), d = 2(d - e T m Q) and c = e T m Qe n - ce m - de n + c . 



Similarly, using the linear transformation 



x = ]-(w + e m ) and y = ^-(z + e n ) (7) 



BQP01 can be reduced to the BQP-11 



Maximize 0(u>, z) = w T Qz + cw + dz + c 
Subject to w G {-1, l} m , 2 G {-1, l} n 



where Q = |Q, c = |(Qe n ) T + §c, d = |e^Q + |d and c = |e^Qe n + |ce m + |cie n + c . 

It is well known that the maximum weight cut problem (MaxCut) on a general graph G 
is equivalent to QP01 [13] . I n the maximum weight cut problem, if we restrict the graph 
Cr to be bipartite, we get an instance of the bipartite maximum weight cut problem which is 
denoted by B-MaxCut. Indeed, viewing B-MaxCut as a general MaxCut problem yields an 
equivalent QP01. Many approximation algorithms for MaxCut assume that the associated 
edge weights are nonnegative [12]. However, for nonnegative edge weights, B-MaxCut is a 
trivial problem since the generic bipartition of the underlying graph gives the optimal cut. 
Thus, the topic that is more interesting is when the edge weights take positive as well as 
negative values. Developing approximation algorithms for BQP01 or for B-MaxCut is not 
the focus of this paper. However, we do want to indicate the equivalence between B-MaxCut 
and BQP01 to further understand the inherent complexity of the problems. 

Let G = (I,J,E) be a bipartite graph. Two vectors x G { — l,l} m and y G {—1,1}" 
determine a cut (U\ U U2, Hi U H2) in G if and only if U\ = {i G / : Xi = 1}, Hi — {i G / : 
Xi = —1}, U2 = {j G J : yj = 1}, and H 2 = {j G J : yj = —1}. We call (x,y) the incidence 
vector of the cut (Ui U U%, Hi U H2). Let g^- be the weight of the edge in G. Then the 
value of the cut (Ui U C/ 2 , Hi U H 2 ) is given by 

ieU l7 jeH 2 ieH 1 ,jeu 2 x»=-% 
Theorem 3. The problems BQP01 and B-MaxCut are equivalent in the sense that: 
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1. For any instance of BQP01, it is possible to construct a complete bipartite graph G 
such that an optimal solution to the B-MaxCut problem on G gives an optimal solution 
to BQP01. 

2. For any instance of B-MaxCut on a bipartite graph G = (I,J,E), it is possible to 
construct an instance of BQP01 with an m x n cost matrix Q such that an optimal 
solution to the BQP01 gives an optimal solution to the B-MaxCut problem on G. 

Proof. Since BQP01 is equivalent to a BQP-ll(H) (see remarks [T] and [2]) , without loss of 
generality we assume that BQP01 is given in the equivalent homogeneous cut form BQP- 
11(H). Now, 

'•'(•'•• y) = Yl qi 3 x ®3 = ' i " - Yl ( ' : ' Yl ( ' : ' 2 ^ 

ij Xi=Vj Xi=~yj ij Xi=~Vj 

Since * s a constant, maximizing 4>(x,y) is equivalent to maximizing — 2$2 ii= _g 

Thus, by solving the B-MaxCut problem on a complete bipartite graph K m ^ n with — 2g^ 
chosen as the weight of the edge we can solve BQP-ll(H). 

To establish the second part of the theorem, we show that the B-MaxCut problem on G 
with edge weights for G E can be solved as a BQP-ll(H). Let (U\ U U2, Hi UH 2 ) be 
a cut in G and (x, y) be the corresponding incidence vector. Let g(U,H) = J2 Xl =- yj c v ^ e 
the value of the cut {U\ U U2, Hi U H 2 ). Then it can be verified that g(U, H) — ^ c ij ~ 
\ c ij x iVj an d) hence, maximizing g(U, H) is equivalent to solving a BQP-ll(H) with cost 
matrix = ~\ c %j- D 



3 Polynomially solvable cases 

Alon and Naor [2j showed that BQP- 11(H) is MAX SNP hard. Using the linear transforma- 
tion 06]), BQP-ll(H) can be reduced to a BQP01 and the reduction preserves the objective 
function values of the corresponding solutions. Thus, BQP01 is also MAX SNP hard. Now 
let us focus on polynomially solvable special cases of BQP01. 

Polynomially solvable special cases of QP01 have been investigated by many authors [U 
EH 113 ED 121 12U- Since BQP01 can be formulated as a QP01 using the transformation 
03]), whenever the transformed data satisfies the known conditions for polynomial solvability 
of QPOl, we can solve the corresponding BQPOl also in polynomial time. So let us focus on 
new polynomially solvable cases that exploit the special structure of BQPOl. 

Theorem 4. BQPOl can be solved in polynomial time if m = O(logra) but remains MAX 
SNP hard if m = O(tyn) for any constant k. Further, if m is fixed, BQPOl can be solved in 
0(n) time. 

Proof. Consider a 0-1 m- vector x° set x = x°. Construct a vector y° as follows: 

J I otherwise . 
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When x is restricted to x°, the choice of y° given by equation (Q yields the maximum 
objective function value. Thus, y° and the objective function value of the solution (x°,y°) 
can be identified in 0(mn) time. Repeat this for all possible choices of the vector x°, 
compute the corresponding y°, and choose the overall best solution obtained in this process. 
This will be an optimal solution to BQP01. Since the number of different choices for x° 
is 2 m and by our assumption m = klogn for some constant k, BQP01 can be solved in 
0{mn2 m ) = 0{n k+l \ogn) time. If m is fixed, the complexity reduces to 0{n). 

To establish that BQP01 is MAX SNP hard when m = 0(^/n), consider an instance of 
BQP01 with data Q, c, d and c . Let 

, c = [ c | c ] , and d — [ d ] d ] , 

where O mxn k, 0( n _ m ) x ( n _ m ) and 0( n _ m ) xn fc are zero matrices, c is a zero vector of dimension 
n — m and d is a zero vector of dimension n k . Now consider the instance of BQP01 with 
data Q, c, d and Cq. It can be verified that this new instance of BQP01 satisfies the condition 
of the theorem. Further, for every solution to the original BQP01, we can find a solution to 
the constructed instance of BQP01, where the corresponding objective function values are 
identical and viceversa. Since BQP01 is MAX SNP hard, the result follows. □ 

If m = 0(log fc n) for fixed k, the procedure discussed in the proof of Theorem H] becomes 
quasi-polynomial. Thus, BQP01 can be solved in quasi-polynomial time if m = 0(\og k n) 
for fixed k. Let us now consider a generalization of Theorem 0] where rank of Q is fixed, 
instead of the number of rows of Q. 

QP01 is polynomially solvable if Q' is a symmetric positive semidefinite matrix [U [101 
[T6l [24] with fixed rank and d = 0. If c' is allowed to have arbitrary elements, the problem 
is NP-hard even if the rank of Q' is one [13]. We now show that BQP01 is solvable in 
polynomial time if rank of Q is fixed. No assumption is made on any other property of Q 
such as positive semidefiniteness and no restrictions on c and d are imposed. As a byproduct 
of this result, we have an alternative polynomial time algorithm to solve QP01 when rank 
of Q' is fixed and Q' is positive semidefinite with the additional flexibility that the vector d 
could be arbitrary. First, let us prove some preliminary results. 

Consider the multiparametric linear programming problem (MLP) 

/(A) = max or 
Subject to: Ax = A 

xe [0,i]"\ 

where A is a p x m matrix of full row rank and A T = (Xi, X 2 , . . . , X p ) G RP. The jth 
column of the matrix A is denoted by Aj. A partition (B, C,U) of / = {1, 2, . . . , m} with 
\B\ = p is referred to as a basis structure for MLP. For each basic feasible solution of MLP, 
a basis structure (B,C,U) is associated, where £ is the index set of nonbasic variables at 
the lower bound 0, U is the index set of non-basic variables at the upper bound 1 and 



Q 



o 



Q 

(n— m) X (n—m) 



o 



O k 

(n—m)xn k 
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B = {Bl, B2, . . . , Bp} is the index set of basic variables. Let B be the p x p matrix with its 
ith column A^i- Then the set B is called a basis set or simply a basis and B is the associated 
basis matrix. A basis provides an implicit ordering of its elements. Thus, xb% is called the 
ith basic variable with respect to B. Let Cb = (cbi, €32, ■ ■ ■ , cb p ). Then the basis structure 
(B, C,U) is dual feasible if and only if [26] 



Conditions (ITU1) and ffTTj) are also known as reduced cost optimality conditions [2S]. Let 
(£>, C, U) be a dual feasible basis structure for MLP. Then the basic solution of MLP corre- 
sponding to this basis structure is optimal for all A G BP satisfying 



where A u is the submatrix formed by columns of A corresponding to the indices of U, e is 
vector of size \U\ with all entry equal to 1, is the zero vector in RP and 1 is the vector in R p 
with all entries equal to 1. The polyhedral set represented by ( I12p is called the characteristic 
region of the basis structure (B,C,U). A dual feasible basis structure (B,C,U) is dual non- 
degenerate if f fTUj) and ffTT]) are satisfied as strict inequalities. If any of these inequalities is 
satisfied as an equality, then (£>,£, W) is a dual degenerate basis structure. 

Let S be the collection of all the extreme points of the characteristic regions associated 
with all dual feasible basis structures of MLP. 

Lemma 5. |5| < m C p 2 p . 

Proof. For simplicity, we assume that all dual feasible basis structures of MLP are dual non- 
degenerate. This is not a restriction since we can achieve this by an e-perturbation of the 
cost vector c in MLP by appropriately small e and this change will not underestimate 
Thus, the inequalities (fTOl and (fTTj) are satisfied as strict inequalities. Consequently, given 
B, the choice of C and U is unique for any dual feasible basis structure, i.e., if (B, C±,Ui) and 
(B, C2M2) are two dual non-degenerate basis structures for MLP then at most one of them 
can be dual feasible. Thus, there exist at most m C p dual feasible and dual non-degenerate 
basis structures for MLP. The characteristic region of such a basis structure (B,£,U) is 
defined by the inequalities ( II 2p . Each extreme point of this polyhedron is determined by the 
unique solution of p tight inequalities from ( I12p . Since there are at most 2 P choices for these 
tight inequalities, the result follows. □ 

Since /(A) is a piecewise linear concave function [15], it also defines a polyhedral set 
and the extreme points of this set are precisely elements of 5*. These extreme points are 
sometimes called breakpoints of /(A). Thus, /(A) will have at most m C p 2 p breakpoints. 

Theorem 6. // s(A°) is an optimal basic feasible solution for MLP at A = A G S then 



CbB~ Aj - Cj > for j G C 
C B B- 1 A J - C j < for j G U. 



(10) 
(11) 



< B~ x \ - B~ x A u e < 1, 



(12) 



x(\°) G {0,1} 
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Proof. Let (£>, C, U) be a basis structure that generated the extreme point A and B be the 
associated basis matrix. Then the vector of basic variables xb associated with {B,C,M) is 
given by 

x B = B^X - B- 1 A u e. (13) 

But A is an extreme point of /(A). Thus from equation ( fl2l) . A is the solution of the 
system i? _1 A° — B~ l A u e = r for some 0-1 vector r. Thus from ffl3|) . xb is a 0-1 vector. The 
non-basic variables of x(X) by definition take 0-1 values and the result follows. □ 

Let us now consider BQP01 where rank of Q is p, a fixed number. Since BQP01 is 
equivalent to UBLP, this problem can be stated as 



UBLP(p): Maximize a k xb k y + cx + dy 



k=l 



Subject to: x G [0, l] m , y G [0, l] n 

where a k = (a k , a^, . . . , a£j and 6 fc = (6j, fof; • • • , b k ) for k — 1, 2, ... ,p. Consider the multi- 
parametric linear program (MLP1) [TB*] 

MLP1: h 1 (\) = m&xcx 

Subject to: a k x — X k for k — 1, 2, . . . , p 

xe [0,i] r 



where A = (Ai, A2, . . . , A p ). Then hi(X) is a piecewise linear concave function \T5\. Let Si be 
the set of breakpoints of hi(X) and x(X) be an optimal basic feasible solution of MLP1 at 
A G Si. By Theorem [61 x(X) G {0, l} m . Let y(X) = (yi(X) , y 2 (X) , . . . ,y n (X)) be an optimal 
solution to UBLP(p) when x is restricted to x(A). Then it can be verified that y(X) satisfies 

y J (X) = { 1 ifd i + n=i^E^^(A)>0 
1 otherwise . 

Theorem 7. There exists an optimal solution to UBLP(p) amongst the solutions {x(X),y(X) : 
XeSx}. 

Proof. UBLP(p) is equivalent to the bilinear program 

p 

BLP1: Maximize X k b k y + cx + dy 

k=l 

Subject to: a k x — X k for k — 1, 2, . . . , p 

xe[0,i} m ,ye[0,i} n . 
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Let h(X) be the optimal objective function value of BLP1 where A is fixed. Now, h(X) can 
be decomposed into h%(\) + h 2 (X), where 



p 



h 2 (X) = max 2^ ^kb k y + dy 

k=l 



Subject to: y G [0, l] n , 



and hi(X) is as defined in MLP1. Then the optimal objective function value of UBLP(p) 
can be identified by finding the global maximum of h(X) over all A G R p for which BLP1 
is feasible. As a function of A, h 2 (X) is piecewise linear convex [T5] and hi(X) is piecewise 
linear concave [13]. Thus, h(X) is piecewise linear but need not be convex or concave. But 
hi(X) is linear when A is restricted to its characteristic region. Thus, h(X) is convex when A 
is restricted to any characteristic region associated with hi(X). Hence, the maximum of h(X) 
is attained at an extreme point of hi(X). Let A = A be such an extreme point and x(A°) be 
an optimal basic feasible solution of MLP1 at A = A . By Theorem [6j x(A°) is a 0-1 solution 
and it yields the optimal value y(X) as given by ( IT3|) for the y variables for UBLP(p) subject 
to the condition that x = x°(X). Since one of the x(X) for A G S gives an optimal x-value, 
the result follows. □ 

Based on Theorem U\ UBLP(p) and hence BQP01 can be solved by generating the 
set Si, computing the set S 2 = {x(X),y(X) : for all A G Si} and choosing the best so- 
lution in S 2 . Since a dense matrix inversion of size p can be carried out in 0(p 3 ) time, 
it can be verified that the overall complexity of this process is 0( m C p 2 p (p 3 + mp + n)) = 

O ( (Jy^) 2 p (p 3 + rap + n)) . Since UBQP(p) and BQP01 are equivalent when Q is of rank 
p we have, 



Theorem 8. BQP01 can be solved in O ( ( — ) e p (p 3 + mp + n) ] time when rank of Q = p. 



Note that for a fixed p the above bound is polynomial and for p = O(logn) it is quasi- 
polynomial. 

For specific choices of p, the complexity of this procedure may be improved. We illustrate 
this for the case when p — 1. Theorem |8] guarantees that if rank of Q is 1, BQP01 can be 
solved in 0(mn) time. We now show that the problem can be solved in O(nlogn) time by 
careful organization of our computations. As in the general case, let us consider the bilinear 
equivalent version: 

UBLP(l): Maximize axby + cx + dy 



where a = (ax, a 2 , . . . , a m ), c= (ci, c 2 , . . . , c m ) G R m and b = (b h b 2 , . . . , b n ), d = (d h d 2 , . . . , d n ) G 
R n . Let A~ = {i : a { < 0}, A = {i : a, = 0} and A + = {i : a* > 0}. Define A = E iG A- a i 
and A = J2 ieA + a^, where summation over the empty set is taken as zero. Note that A and 




Subject to: x G [0, l} m ,y G [0, l] n , 
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A are respectively the smallest and the largest values of ax when x G [0, l] m . Consider the 
parametric continuous knapsack problem (PKP(A)) given below. 

PKP(A): Maximize cx 

Subject to: ax = A 

x G [0, l] m , and A < A < A. 

This is a special case of MLP1 for p = 1. Let hi(X) be the optimal objective function 
value of PKP(A) for a given A. Then for A < A < A, hi(X) is a piecewise linear concave 
function [26]. Let A = Ai < A2 < ■ ■ • < A r = A be the breakpoints of hi(\), x k be an optimal 
basic feasible solution of PKP(A) for A G [A&, A^+i], 1 < k < r — 1, and x r be an optimal 
basic feasible solution to PKP(A r ). Let y k be an optimal solution to UBLP(l) when x is 
restricted to x k , the vector y k can be identified by appropriate modification of the equation 
(TH|) . By Theorem 0, there exists an optimal solution to UBLP(l) amongst the solutions 
x k , y k : k = 1, 2, . . . , r. 

From Lemma [5l the number of breakpoints of h\(X) is at most 2m. We now observe that 
the number of breakpoints of h\{\) cannot be more than m + 1 and obtain closed form values 
of these breakpoints. Define 



ft; 



Ci if a, > 
— c, if a, < 0. 



ft; 



Let T = < - — - : i = 1,2, . . . ,m, a« 7^ > and consider a descending arrangement 
aA 



> ^7 > ■■■> 



I ^7Tl I J ^71 



ft T . 



(15) 



are given by 



of all distinct elements of T. Let T{k) = {i '■ 7ffc . = -r— l -r \. Then the breakpoints of hi(X) 



"Tfc I 



\ a i\ 



Ai = A and A& = Afc_i + |ai| for k = 2, 3, . . . , r. 

ieT(fc) 

An optimal solution to PKP(A) at A = A& for A; = 1, 2, . . . , r can be identified recursively 



as 



if a, = and > or < 
otherwise 
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x k ~ l if i i T(k) 
and x k — I 1 if i e T(k) and a { > 
[0 otherwise, 

with the corresponding objective function values 

rn 

= ^ Cjx\ and fri(Afc) = /ii(A fc _i) + a*. 

Given /i(Afc) and x fc , /i(Afc+i) and x fc+1 can be identified in 0(\T(k + 1)|) time. The com- 
plexity for generating these solutions and breakpoints are dominated by that of constructing 
the descending arrangement ([15]) which is O(mlogm). Note that hi(X) has at most m + 1 
breakpoints and given x k a corresponding solution y k can be computed in 0(n) time. This 
leads to a complexity of 0(mn). The bottleneck operation here is the computation of y k for 
k — 1, 2, . . . , r. We now show that these points can be identified in 0(n log n) time. 

Consider the parametric unconstrained linear optimization problem 



ULP(yu): Maximize dy + \iby 

Subject to: y G [0, l] m and A < \i < A. 

Let /i 2 (/-0 be the optimal objective function value of ULP(/i). Then /i 2 (/i) is a piecewise 
linear convex function. 

Let S+ = {j : dj + Xbj > 0}, 5" = {j : d,- + Xbj < 0}, 5+ = {j : bj > 0}, and 
B- = {j : bj < 0}. Also, let T 2 = {- : j E (S + fl £~) U (5~ fl £+)} and consider an 
ascending arrangement 

A<-^L<-^i...<-^l (16) 

of all distinct elements of T 2 greater than A. Let fa, // 2 , • • • , be the breakpoints of h 2 (fi). 
Then 

^ = -^for£=l,2,...t 

Let Aj = {j :jG(S + nr)U (5" fl B + ) and ^ = ^n}. Then the optimal solution y t for 
ULP(//) corresponding to the breakpoint [i£ for I — 1, 2, . . . , t is given recursively by 

r ^j- 1 if j g a, 

y e j=y ifj'G A.andyj-^O 
[o if j e A^ and y l f l = 1. 
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-e-/n(A) 




fJ.& 2 A 3 ^5 



Figure 1: An example of hi(X) and ^(/f) when a = [2, 2, -3, 4, -2], c 
[1,1,-4, 0,-1,-2, l],d=[5,-2, 3, 3,4, 0,2]. 



A 5 

[4, 5, 6, 10, 5], b 



where 



Define 



1 if j G 5+ 
otherwise . 



jes+ jes+ 
D i = D e-i _ J2 dj+ d 3 and 

Then the optimal objective function value at fj,£ is given by h^nt) = D l + fxgB^ 

Given y , D l ~ l and B , we can compute y , D e , and 5^ in 0(|A^|) time and, hence, 
/12 ) and y l can be identified in 0(|A^)| time. Since A^ fl A& = for £ ^ k, y e and h,2{f/) 
for £ = 1,2, ... ,t can be identified in O(nlogn) time. 

Now the algorithm for solving UBLP(l) can be described as follows. First, compute 
x 1 , y 1 , hi(X) and h 2 (X). Set f(x 1 ,y 1 ) = hi(X) + h 2 (X). Sort all breakpoints of hi(X) and 
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/^(/•O f° r A A, /jt < A (see Fig: [TJ) and scan these breakpoints starting from A in the 
increasing order. As we pass breakpoints of h 2 (fj) keep updating the solution y of ULP(/i) 
corresponding to this breakpoint and the objective function value of this solution until we 
hit a breakpoint A& of hi(X). At this point compute the solution x k and /ii(Afc). The most 
recent solution y identified is selected as y k and compute ^(Ajt). Note that ^(Ajt) can be 
obtained in 0(1) time using slope of /^(aO for the interval containing X k . Update f(x h ,y k ) 
and the process is continued until all breakpoints of hi(X) including A are examined and 
the overall best solution is selected. It is not difficult to verify that the complexity of this 
procedure is O(nlogn). 

Let us now consider a special case of BQP01 when Q is of rank one (equivalently a special 
case of UBLP(l)) of the form 

BQP01(1,0): Maximize (a + ax)(b + by) + cx + dy 

Subject to: x G [0, l] m ,y G [0,1]™, 

where either c = or d = 0. We now show that this problem can be solved more efficiently 
Theorem 9. An optimal solution to BQP01(1,0) can be identified in 0(n) time. 
Proof. Suppose d = 0. Consider the following solutions 

if 6, > , f 1 if 6, < 

and y j — \ 

otherwise . 

Note that y° = (y®, y®, ■ ■ ■ , maximizes b + by and y* = (y*, y|, . . . , y*) minimizes b + by 
with respective objective function values, say, A and A*. Consider the function 

L(A) = Maximum xe {o,i}"i {(a + ax) A + cx} . 

L(A) is a piecewise linear convex function of A. As A varies in the interval [A*, A ], L(X) traces 
the best objective function values for BQP01(1,0) for all possible solution vectors y. Thus, 
BQP01(1,0) reduces to maximizing L(X) for A G [A*, A ]. Convexity of £(A) guarantees that 
its maximum is attained when A = A or A*, i.e., when y = y° or y = y*. But when y = y°, 
an optimal x° is given by 

' 1 if aiX° + d > 
otherwise 




Similarly, when y = y* an optimal solution x* is given by 



x : 



1 if <2jA* + Q > 
otherwise . 



Thus, the best solution amongst (x°,y°) and (x*,y*) solves BQP01(1,0). For c = 0, the 
proof is similar. □ 
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We now show that our algorithm for solving BQP01 when rank of Q is fixed can be used 
to solve QP01 when Q' is positive semidefinite. Let QP01(PSD,Q', d, n) denotes an instance 
of the QP01 on n variables on data Q' , d where Q' is positive semidefinite with fixed rank 
and let BQP01(Q', d , n) denote an instance of BQP01 where m = n, Q = Q' and c = d = |c'. 
Then we have, 

Theorem 10. If x* is an optimal solution to QP01(PSD,Q',d,n) and (x°,y°) be an optimal 
solution to BQP01(Q', d , n). Then both x° andy are optimal solutions to QP01(PSD,Q', c', n) 
and (x*,x*) is an optimal solution to BQP01(Q',c',n). 

The proof of the above theorem follows from a corresponding result from bilinear pro- 
gramming [T7] and the equivalence between BQP01 and UBLP. An interesting consequence 
of this theorem is that our polynomial time algorithm for the case when rank of Q is fixed can 
be used to solve QP01(PSD,Q', d, n) yielding a new alternative to the algorithms discussed 
in [H [TUl [ESI [21] with the additional flexibility that d could be arbitrary. 

In the case of QP01, if = cij + bj for i e I, j G J, the resulting problem is trivial. 
However, for BQP01, the condition q^- = aj + bj for i 6 J, j £ J yields an interesting 
polynomially solvable case. Note that when qij = a« + bj, rank of Q is at most 2 and hence 
can be solved in polynomial time. We now present an 0(mn log n) algorithm to solve this 
problem. 

Theorem 11. If = a, + bj fori £ /, j G J, then BQP01 can be solved in O (mn log n) . 
Proof. For any feasible solution x, y, 

f(x, y) = x T Qy + cx + dy + c 

m n n m m n 

= ^ a i X i ^2 y i + Xi + ° iXi + S d 3Uj + c o- 

i=l j=l j=l i=l i=l j=l 

Let Y^Ij=i Vj = K an d ^2iL% x i = L, where K and L two parameters. Then, 

m n 

f(x, y) = ^2(Kai + d)xi + ^2(Lbj + dj)yj + c . 
Consider the optimization problem 

m n 

ILP(K,L): Maximize ^y^^Kaj + Ci)xi + ^^(L6j + dj)yj + cq 

i=l j=l 
n m 

Subject to ^2 Vj = K an d Xi = L 

j=l i=l 

For K = 0,1, ... ,n, let a K be a permutation of size m such that Ka a Ku-\ + c a Ku\ > 
Ka a K (i+i) + c a K (i+i)i i — 0, 1, ... ,m — 1. For L = 0,1, ... ,m, let (3 L be a permutation 
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of size n such that LbpLu\ + dpLQ) > LbpL(j +1 ^ + dpL^ +1 ^ j = 1, 2, . . . , n — 1. Observe 
that, for fixed K and L, the optimal x = x K,L can be obtained by setting Xj = 1 for 
z = a^(l), <x^(2), . . . , a K (L) and Xj = for the rest of indices. Similarly, the optimal 
y = y K ' L can be obtained by setting yj = 1 for j = /3 L (1), /3 L (2), . . . ,(3 L (K) and t/j = for 
the rest of indices. 

Let fi' L = Y^T=i(Kcii + Cj)Xj ' and f^' 1 = Sj=i(-^j + dj)yf' L - Assume that we know 
the value of f^' L for some K and L. Then we can calculate f^' L+1 in 0(1) time as: 

Jl = h + Aa a A '(L+l) + C Q if(L+l) • 

Observe also that / x ,0 = 0. Hence, for a fixed i^, we can calculate f^ ,L for each L G 
{0, 1, . . . ,m} in 0(m) time. Similarly, for a fixed L, we can calculate f^' L for each = 
0,1,..., n in O(n) time. Let (K°,L°) be the values of K and L that maximize f^ ,L + 
Then the optimal solution of the BQP01 is (x K ° ,L ° ,y K ° ,L °), and it can obtained in 

(nm log m + mn log n + mn) = O (van log n) time. □ 

An integer linear programming formulation of BQP01 can be obtained using standard 
linearization techniques [H] as follows: 

m n m n 

ILP: Maximize Qij z ij + c i^i + <^jl/j (17) 

i=l j=l i=l j=l 

Subject to Zij — Xi < 0, i G /, j G J (18) 

Zij -Vj <0,i £ I,j E J (19) 

% - Zi - % > -1, (i, j) G 5 1 , (20) 

Xi G {0, 1} for i G /, ?/j G {0, 1} for j G J, z i3 - G {0, 1} for e I x J, (21) 

where S = {ij : qij < 0}. Note that each constraint f )20|) forces the variable 2^ to take value 

1 if both Xi and i/j are one. We introduce such a constraint only when < 0. If > 0, 
then, since the objective function is being maximized, will be forced to take the value 1 
whenever both Xi and yj are 1 and hence explicit constraint in this case is unnecessary. If 
q^ = 0, the value of is irrelevant. This leads to another polynomially solvable case. 

Theorem 12. Let \{ij : q^ < 0}| = p. Then BQP01 can be solved in polynomial time if 
p = O(logra) and it is NP-hard if p = \fri. 

Proof. Let p = O(logn). Deleting constraints (12"U|) from ILP results in a totally unimodular 
system which can be solved in polynomial time. There are at most 3p binary variables 
associated with equation ff20l . Thus, there are at most 2 3p possible combinations of values 
of these variables. Substituting each such combination in ILP results in the elimination of 
the constraints and variables corresponding ( 1201) and the resulting system will be totally 
unimodular and have at most two variables per inequality. Thus the reduced ILP can be 
solved in polynomial time [25]. Thus, ILP can be solved by choosing the best solution 
amongst the solutions of these reduced ILPs. Since the total number of reduced ILPs is 



17 



at most 2 3p and p = O(logn), the number of reduced ILP considered is 0((n) 3k ) for some 
constant k and the result of the first part follows. 

For the second part, the proof follows by reducing a general BQP01 to a BQP01 satisfying 
the conditions of the theorem. This can be achieved by increasing the number of columns 
of Q to sufficiently large, yet polynomial for fixed k and filling these columns with entries 
0. □ 

It may be noted that Theorem [T2l allows arbitrary c and d. The special case of Theorem [T2l 
where > for all has been reported by many authors [27] in the context of QP01. 
The general version discussed in Theorem [121 for BQP01 extends to QP01 as well. 



4 Conclusion 

In this paper we studied the problem BQP01 which generalizes QP01, a well studied combi- 
natorial optimization problem. BQP01 is known to be MAX SNP hard. Several interesting 
polynomially solvable special cases of the problem are identified. In particular, we showed 
that when rank of the matrix Q is fixed, BQP01 can be solved in polynomial time and im- 
proved complexity results are provided for the rank one case and a special case when rank 
of Q is at most two. By restricting m = O (log ri) or by restricting the number of negative 
entries of Q to O(logn), we obtained additional polynomially solvable cases. If m = \fri 
BQP01 is MAX SNP hard and a similar result is obtained if the number of negative entries 
in Q is O(tyn). It would be interesting to explore the complexity of the problem when the 
problem size or data restrictions fall in between these extreme cases. Exploiting the algo- 
rithms for our polynomially solvable special cases, efficient exact and heuristic algorithms 
may be obtained to solve BQP01. This is a topic for further investigation. 
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